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Abstract 

Background: Achieving high rates of adherence to antiretroviral therapy (ART) in resource-poor settings comprises 
serious, but different, challenges in both the first months of treatment and during the life-long maintenance phase. 
We measured the impact of a health system-oriented, facility-based intervention to improve clinic attendance and 
patient adherence. 

Methods: This was a quasi-experimental, longitudinal, controlled intervention study using interrupted time series 
analysis. The intervention consisted of (1) using a clinic appointment diary to track patient attendance and monitor 
monthly performance; (2) changing the mode of asking for self-reported adherence; (3) training staff on adherence 
concepts, intervention methods, and use of monitoring data; (4) conducting visits to support facility teams with the 
implementation. 

We conducted the study in 12 rural district hospitals (6 intervention, 6 control) in Kenya and randomly selected 1894 
adult patients over 18 years of age in two cohorts: experienced patients on treatment for at least one year, and newly 
treated patients initiating ART during the study. Outcome measures were: attending the clinic on or before the date of 
a scheduled appointment, attending within 3 days of a scheduled appointment, reporting perfect adherence, and 
experiencing a gap in medication supply of more than 14 days. 

Results: Among experienced patients, the percentage attending the clinic on or before a scheduled appointment 
increased in both level (average total increase immediately after intervention) (+5.7%; 95% CI = 2.1, 9.3) and trend 
(increase per month) (+1 .0% per month; 95% CI = 0.6, 1 .5) following the intervention, as did the level and trend of 
those keeping appointments within three days (+4.2%; 95% CI = 1 .6, 6.7; and +0.8% per month; 95% CI = 0.6, 1 .1 , 
respectively). The relative difference between the intervention and control groups based on the monthly difference in 
visit rates increased significantly in both level (+6.5; 95% CI = 1 .4, 1 1 .6) and trend (1 .0% per month; 95% CI = 0.2, 1 .8) 
following the intervention for experienced patients attending the clinic within 3 days of their scheduled appointments. 
The decrease in the percentage of experienced patients with a medication gap greater than 14 days approached 
statistical significance (-1 1.3%; 95% CI = -22.7, 0.1), and the change seemed to persist over 1 1 months after the 
intervention. All facility staff used appointment-keeping data to calculate adherence and discussed outcomes regularly. 

Conclusion: The appointment-tracking system and monthly performance monitoring was strengthened, and patient 
attendance was improved. Scale-up to national level may be considered. 
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Background 

HIV and AIDS continue to affect millions of people 
globally, particularly those in sub-Saharan Africa. By 
December 2010, approximately 432,000 patients in Kenya 
were receiving antiretroviral therapy (ART), which was an 
absolute increase of 28% over 2009 figures and repre- 
sented 61% of those in need [1]. More than 80% of 
patients in Kenya remain on treatment one year after 
initiating ART [1,2]. 

Adherence rates can vary enormously between facilities 
[3], and poor adherence to long-term therapies compro- 
mises treatment effectiveness, making this a critical public 
health issue [4]. Non-adherence to prescribed ART is 
one of the strongest predictors of progression to AIDS 
and death among people living with HIV [5]. It is also 
associated with the development of drug-resistant viral 
strains [6]. 

Among patients on ART, different challenges are faced, 
both at the patient level and at the system level, during 
the early/first months of treatment as compared to the 
maintenance phase. Such challenges may include disclos- 
ure, food insecurity, access to HIV Information Education 
and Counselling material, and stigma. It is known that 
most adherence failures occur early in the course of 
treatment [7,8]. 

Appointment-keeping rates correlate with treatment 
outcomes (i.e., weight gain and CD4 counts) [9]. Bisson 
and colleagues showed that using pharmacy refills to 
assess ART adherence was as accurate as CD4 counts for 
detecting virological failure [10], while Paterson et al. 
demonstrated that resistance to antiretrovirals decreased 
with better adherence [11]. Visiting clinics early after initi- 
ation of ART is an independent predictor of long-term 
clinical progression in HIV-positive patients [7]. 

Although research has shown that adequate ART adher- 
ence rates can be achieved in resource-poor settings [12], 
there are concerns that adherence to ART in such settings 
may decline as treatment access increases [13]. Previous 
multi-country studies in Ethiopia, Kenya, Rwanda, and 
Uganda have identified the need to strengthen health 
systems, so that facilities can use routine data to improve 
adherence and clinic attendance [3,14]. 

Qualitative studies in Uganda and Ethiopia identified 
several factors that affect ART adherence. Survey 
respondents cited lack of appointments, overcrowding, 
and no effective mechanisms for community outreach to 
defaulters as key systems failures associated with low 
adherence [8]. In Kenya, challenges in monitoring 
adherence include difficulty in tracking patients and 
identifying defaulters, weak community linkages, 
shortage of skilled community health workers, lack of 
adherence monitoring tools, large numbers of patients, 
and lack of national guidelines on adherence monitoring 
[15]. 



The objective of this intervention study was to 
strengthen clinical appointment and adherence monitor- 
ing systems in Kenyan health facilities and measure any 
effects on the patients' attendance and adherence to ART 
using standard indicators [16]. 

Methods 

Study design and setting 

We conducted a longitudinal cohort study in a conveni- 
ence sample of 12 rural health facilities situated in Central 
(2 facilities), Rift Valley (4 facilities), and Eastern 
(6 facilities) provinces in Kenya. The facilities were 
sampled from the monitoring and evaluation database 
maintained by the Kenya National AIDS & STI Control 
Programme (NASCOP), and was implemented over a 
one-year period. Healthcare providers at the facilities 
included medical officers, clinical officers, nurse practi- 
tioners, pharmacy practitioners, and records officers. 

Facility sample 

The inclusion criteria for sampled health facilities were 
providing ART for at least one year prior to the study, 
having between 100 and 500 adult patients on ART, and 
being located within 200 km from Nairobi. We selected 
six intervention facilities that met the criteria and an 
additional six control facilities that were matched to each 
intervention facility based on geographical location, 
number of patients on ART, and level of care. Facilities 
that offered food or other economic support to patients, 
had ongoing research activities, or that had been affected 
by the post-election political instability in 2007 were 
excluded from the study. 

Study population 

The study population included patients aged 18 years or 
more, who were on ART. We also collected data on the 
intervention implementation process from selected staff at 
each clinic. The patients selected for the study were 
allocated to one of two cohorts. The reason for this 
division of patients was to account for the different chal- 
lenges faced by staff during the first months of treatment, 
compared to during the life-long maintenance phase. The 
first cohort included ART-experienced patients, who had 
initiated treatment at least one year prior to the study and 
who had visited the clinic at least once between 13 and 
15 months prior to the baseline survey. The second 
cohort included all newly treated patients recruited 
month-by- month from 12 months pre-intervention and 
through the post- intervention period. We analyzed only 
their first 120 days of treatment. 

In each facility, we aimed to sample 100 experienced 
patients and as many newly treated patients as possible. 
Patients had all initiated treatment at the facility in 
question; those who had transferred in or who had prior 
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exposure to ART, such as through prevention of mother- 
to-child transmission programs, were excluded. 

Patients initiated on antiretroviral therapy were sched- 
uled for an appointment in two weeks for first review. 
Thereafter, time between appointments ranged from one 
month up to a maximum of three months for clinically 
stable patients. Medicines were dispensed based on the 
days until the next clinic visit, with the normal amount of 
pills lasting between 30 to 90 days. 



ART clinic register, and then selected 100 patients who 
qualified for the study. We also used the ART register to 
identify the newly treated cohort of patients who started 
ART during the period from 12 months prior to the 
baseline survey date up to 3 months before the date of 
final data collection. Data on perfect adherence was 
abstracted from the patient clinical record (MoH-257) 
based on the patients self-reported, recalled perfect 
adherence during the three days prior to clinic visit. 



Data collection 

Trained data collectors with backgrounds in clinical 
medicine, pharmacy, nursing, or social science abstracted 
quantitative data from patients' clinical and pharmacy 
records. Data were collected in two waves — a baseline 
survey that took place one month before the start of the 
intervention, and a follow-up survey 13 months after the 
start of the intervention. We developed and pretested data 
collection instruments in two ART facilities prior to 
beginning the study. All study tools are available on 
request from the first author. 

Data for the cohort of experienced and new patients 
were extracted from the ART clinic register and individual 
patient files. We initially sampled 120 records from the 



Study variables 

Variables extracted from the clinic and pharmacy records 
are included in Table 1. The outcomes for the study 
included several calculated measures of clinic attendance 
and treatment adherence: 1) attending the clinic on or 
before the scheduled date, 2) attending the clinic within 
3 days of the scheduled appointment date, 3) reporting 
perfect adherence, and 4) experiencing a gap in medica- 
tion supply from the clinic of more than 14 days between 
recorded visits. In order to obtain the gap in medication 
supply, the records of dispensing done during each clinic 
or ART pharmacy visit were reviewed, and the total daily 
doses of dispensed medicines were recorded for each 
patient visit. 



Table 1 Summary of patients' demographic and clinical characteristics 



Characteristics of study population 
(n = 1894) 



Experienced cohort 1 



Newly treated cohort ' 



Intervention 
(n = 446) 

289 (64.8%) 
39.4 (38.3-40.5) 



Female (n = 1258) 
Mean age (95% CI) 
Marital status (%) 

Single 72(16.1%) 
Divorced/Widowed 1 1 9 (26.7%) 

Married 181 (40.6%) 

Weight at start of follow-up — mean (95% CI) 



Male 
Female 

WHO stage at ART initiation (%) 
Stage 1 
Stage 2 
Stage 3 
Stage 4 



58.5 (56.7,60.3) 
54.8 (53.5,56.0) 

14 (3.1%) 
61 (13.7%) 
278 (62.3%) 

31 (7%) 



Control 

(n = 352) 

248 (70.5%) 
38 (37.1-38.9) 

43 (12.2%) 
114 (32.4%) 
159 (45.2%) 

58.3 (56.8,59.9) 
55 (53.9,56.1) 

46 (13.1%) 
84 (23.9%) 
172 (48.9%) 
22 (6.3%) 



p-value 

0.0908 
0.065 

0.1157 



0.8974 
0.796 

<0.0001 



Intervention 
(n = 520) 

337 (64.8%) 
38.6 (37.7-39.5) 

79 (15.2%) 
140 (26.9%) 
253 (48.7%) 

54.9 (53.5,56.3) 

52.3 (51.1,53.5) 

50 (9.6%) 
146 (28.1%) 
247 (47.5%) 
31 (6%) 



Control 

(n = 576) 

384 (66.7%) 
39.2 (38.4-40.1) 

79 (13.7%) 
186 (32.3%) 
268 (46.5%) 



57.3 (56,58.5) 0.0144 

52.8 (51.7,53.8) 0.5529 



88 (15.3%) 
199 (34.5%) 
224 (38.9%) 
21 (3.6%) 



p-value 

0.5171 
0.349 

0.1987 



0.0003 



CD4 value at ART initiation— mean (95% CI) 

CD4 value 293 (269.1,316.9) 334.3 (309.8358.8) 0.0183 169.2 (154.5,183.9) 189.4 (176.1,202.7) 0.0466 

Evidence of adherence counselling prior to ART initiation 

Adherence counselling 387 (86.8%) 238 (67.6%) <0.0001 457 (87.9%) 401 (69.6%) < 0.0001 

*Missing data: marital status n = 201 ; WHO staging n = 1 80; initial CD4 n = 470; initial adherence counseling n = 3. 
NB: Figures in bold show significant differences. 
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Description of the intervention 

The intervention consisted of the following four 
components: 

1) Implementing a clinic appointment diary system for 
tracking patient attendance. The diary comprised a 
12-month record of visits for each patient including 
the scheduled appointment date and the exact 
attendance date for each visit. The diary also 
included an option for the facility to monitor 
monthly appointment-keeping performance for all of 
their patients on ART. The diary helped the facilities 
quickly identify patients who missed appointments 
and then initiate timely follow-up. Patients who 
missed appointments were targeted for more 
focused counselling. 

2) Modifying the national routine patient monitoring 
form (MoH-257) (Additional file 1). The forms self- 
reported adherence question, which is asked by 
trained clinicians during each patient encounter, was 
changed to read as follows: "Have you missed any 
medicine in the last three days?" The answer was 
used to identify patients with less than perfect 
adherence. Patients reporting missed doses received 
extra adherence counselling. 

3) Conducting targeted training of health service 
providers drawn from each intervention site. The 
training curriculum included content on basic 
adherence concepts adapted from the national 
adherence training curriculum, introduction to 
adherence intervention tools, how to extract data to 
measure attendance-based indicators, and how to 
analyze and use the data to inform decision-making 
at the facility. 

4) Visiting the facility teams to support their 
implementation of the intervention. We paid 
particular attention to helping the facility 
calculate their monthly appointment-keeping rate 
(the percentage of patients arriving on or within 
three days of their appointment) and use the 
information during their monthly staff meetings. 

Implementation of the intervention 

We phased in the intervention, beginning with the first 
three facilities in March 2008 and following with the next 
three facilities three months later. This timing was 
intended to control for any simultaneous external inter- 
ventions that could influence the study outcomes. The 
control facilities were not exposed to the intervention, and 
contact with them was made only at the final evaluation. 

The intervention in each facility was implemented over 
two months. To enhance buy-in among staff, the initial 
training targeted key people, including the facility in- 
charge, officer in-charge of the ART clinic, records officer, 



pharmacist, clinician, and nurse. The training introduced 
the study tools and disseminated preliminary feedback 
from the baseline survey. During the training, each 
facility developed its own intervention implementation 
plan adapted to their setting. We thereafter made 
reinforcement visits two weeks after the initial training, 
and two months after the first reinforcement visit. 

Supervision visit were also scheduled three months after 
the second reinforcement visit for preliminary evaluation 
of the implementation process. During these visits, the 
study team reviewed the documentation in the diary and 
the MoH-257 form, the calculation of the appointment- 
keeping indicators from the clinic attendance diary, and 
the recording of self-reported adherence. The study team 
worked with the comprehensive care clinic team to iden- 
tify gaps and challenges in the implementation and docu- 
mented the implementation process, including use of the 
diary, calculation of indicators, and how indicators were 
used for monitoring and improvement. The providers did 
not receive any incentives other than the training and 
follow-up that was part of the intervention package. 

Data management and analysis 

Data extracted from clinical records were entered twice 
into standardized Excel worksheets, compared and 
corrected, and then analyzed using Stata v. 11 (StataCorp 
LP, College Station, Texas, USA). We first compared the 
characteristics of the intervention and control study 
groups using frequency distributions and summary statis- 
tics. All study outcomes were then expressed as monthly 
percentages. We used segmented regression analysis to 
evaluate the effects of the intervention. The regression 
models included terms to estimate the baseline trend 
(slope), as well as changes in the level immediately after 
intervention, and the post intervention trend (slope) of 
each outcome of interest. A change in level would indicate 
an immediate effect of the intervention on the outcome 
indicator of interest, while a change in trend (or slope) of 
the regression line would point to a longer, more sustained 
response for the indicator measured. We excluded a two- 
month lag period following the beginning of the interven- 
tion from our models to reflect the time needed for the 
intervention to take effect (i.e., the expected time until 
most patients scheduled prior to the intervention would 
have made a follow-up visit). 

Missing data in Table 1 (Demographic characteristics) 
was highest for CD4 data and WHO staging. Those 
experienced patients with either missing CD4 or WHO 
staging data in each study arm did not have significantly 
different outcome data (change in level or change in trend, 
of the outcome "Appointment keeping to within 3 days") 
compared to the rest of the experienced patients. 

Recording of self reported perfect adherence was 
occasionally missing in the MoH 257 form. Notably, one 
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control facility did not record this outcome consistently, 
and therefore about 79% of data was missing. In evaluat- 
ing this specific outcome, only the experienced patients 
with at least one record of self reported perfect adherence 
available were considered (328 of 353 in the intervention 
facilities, and 418 of 446 in the control facilities). 

During data collection, all possible attempts were made 
to ensure that patients' medicine supply data were 
collected, but after cleanup and validation, data were 
missing in 16.2% of patient visit records in control 
facilities and 12.4% in intervention facilities. It was 
however noted that pharmacy refills were being issued, in 
almost all cases, in whole packs of medicines i.e. in 
multiples of discrete and known numbers based on the 
quantities of pills in the respective packs, related to the 
number of weeks remaining until the client s next clinical 
appointment. This is commonly done so that the clients 
have enough medicines to meet their needs until the next 
clinic visit date. We imputed missing dispensing data 
based on this assumption. 

Ethical considerations 

The Kenyatta National Hospital Ethics and Research 
Committee granted ethical approval to conduct the study. 
Patient names were not recorded on any of the data 
collection forms, and each patient record was assigned a 
unique identifying number. Written informed consent 
was sought for all interviews conducted and children were 
excluded in this study. 

Results 

Demographic characteristics 

The study included 1894 patients; the experienced cohort 
comprised 798 patients (67% female) with a mean age of 
39.4 years for intervention sites and 38.0 years for control 
sites. A significantly greater percentage of experienced 
patients at the intervention sites (69%) were started on 
treatment at more advanced stages of illness (World 
Health Organization [WHO] stages 3-4) compared to 
control sites (55%). Rates of adherence counselling prior 
to initiation of ART were significantly higher in the 
intervention sites (87%) compared to control sites (68%) 
(Table 1). 

The newly treated cohort comprised 1096 patients 
(66% female), with a mean age of 38.6 years for interven- 
tion sites and 39.2 years for control sites. As with 
experienced patients, a significantly greater percentage 
of patients in intervention sites (54%) were started on 
treatment at WHO stage 3-4 compared to the control 
sites (43%). Adherence counselling prior to initiation of 
ART in this cohort was also significantly higher in the 
intervention sites (88%) compared to control sites (70%) 
(Table 1). 



Appointment keeping 

Appointment-keeping trends for new and experienced 
patients at both intervention and control facilities were 
relatively steady during the pre-intervention period 
(Figures 1, 2, 3). 

Experienced patients had significant increases in both 
the level (average total increase immediately after 
intervention) (+5.7%; 95% CI = 2.1, 9.3) and trend 
(increase per month after intervention) (1.0% per month; 
95% CI = 0.6, 1.5) of on-time appointments (Table 2). We 
observed similar changes in the rates of patients attending 
the clinic within 3 days of their scheduled appointments, 
with an increase in level of attendance of 4.2% 
(95% CI = 1.6, 6.7), and a monthly trend increase of 0.8% 
(95% CI = 0.6, 1.1). Appointment-keeping at the control 
facilities did not change. 

The relative difference between the intervention and con- 
trol groups based on the monthly difference in visit rates 
increased significantly in both level (+6.5; 95% CI = 1.4, 
11.6) and trend (1.0% per month; 95% CI = 0.2, 1.8) follow- 
ing the intervention for experienced patients attending the 
clinic within 3 days of their scheduled appointments 
(Table 2). 

Among newly treated patients, there was an immediate 
significant increase in percentage of patients attending 
clinic on time (8.8% 95% CI = 1.2, 16.3) in the intervention 
cohort, but no significant change in trend or any other 
outcome variables in this patient group (Table 2). 

Medicine gaps of more than 14 days 

The level of experienced patients who had a gap in medi- 
cation supply of more than 14 days (Figure 4) decreased 
following the intervention (-11.3%; 95% CI = -22.7, 0.1), 
but the decrease did not reach significance (p = 0.051), 
and the trend did not change. The newly treated cohort in 
the intervention sites and the control sites showed no 
significant changes in medication gaps after the interven- 
tion (Table 2). 

Self reported recalled perfect adherence 

Over 90% of patients in the intervention and control 
groups recorded a self-reported perfect adherence during 
both the pre- and post-intervention periods, and no 
significant changes in either level or trend were found. 

Uptake of the intervention 

Staff from all intervention facilities used the study tools 
successfully. The study teams supportive supervision 
helped to resolve challenges, such as staff members not 
completely filling out the diary at the beginning of imple- 
mentation. The diary was useful in determining who 
turned up for appointments and for initiating timely 
follow-up for clients who missed their appointments. 
Those who missed appointments were contacted and 
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Figure 1 Percentage visits kept or attended before appointment for experienced patients. 



given more focused attention when they came back to the 
clinic, even if on their own volition. Providers used 
the revised MoH-257 patient record card and found 
the question on self-reported perfect adherence within the 
previous three days easy to administer to patients at the 
clinics. Clients who missed treatment doses were referred 
for more adherence counselling to help them overcome 
barriers to adherence and emphasize its importance. 

Trained staff at the facilities calculated appointment- 
keeping indicators using a monthly summary sheet 
in the diary. During regular staff meetings to monitor 
intervention progress, the percentages for each of the 
appointment-keeping indicators were used to discuss facil- 
ity performance. In addition, in some facilities that had 
not been holding such routine meetings, the intervention 
reinforced the practice. 

Discussion 

Our findings show that it was possible to strengthen the 
appointment-keeping and performance-monitoring sys- 
tem in ART clinics in resource-constrained settings, and 
improve clinic attendance, through reviewing standardized 



appointment-keeping indicators during monthly facility 
management meetings. However, we were not able to 
show any improvement in adherence to treatment. 

Among both experienced and newly treated patients in 
intervention facilities, rates of appointment-keeping 
consistently increased after the intervention compared to 
controls. The experienced patients had close to a signifi- 
cant decrease in medication gaps, which was sustained for 
11 months after the start of the intervention. The level of 
changes (4.2-8.8%) may seem small, but should be seen in 
the context of the very large number of people on ART. If 
similar improvements could be achieved at the national 
level, between 18,000 and 38,000 patients would have a 
more favourable therapeutic outcome. 

Standardized appointment-keeping indicators are useful 
in monitoring facility performance and promoting the use 
of routine data. The introduction of the appointment diary 
allowed service providers to periodically generate a list of 
patients who missed appointments. Failure to come to the 
facility for a scheduled visit provided an early warning that 
a patient was at risk of non-adherence [17]. Performance 
measurement raises awareness of existing practices and is 
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an important driver for improvement [18]. The monthly 
facility summary enabled staff to track their performance 
level and motivated them to strengthen their practices. 
The limited use of available data to improve facility 
performance has previously been mentioned as a major 
challenge for many facilities in Kenya [14]. 

Patients need to attend appointments consistently to 
manage clinical issues related to ART and to avoid gaps in 
therapy [3], and coming to the clinic regularly has been 
significantly associated with optimum medication adher- 
ence [19]. Patients' failure to attend the clinic when 
expected is an objective indicator that is easy to ascertain 
[9]; inconsistent attendance can identify patients requiring 
more focused interventions such as adherence counselling 
or outreach [16]. A common measure of ensuring patient 
retention in ART involves tracking patients who have 
missed their appointments [20,21]. Information from the 
appointment diary also enabled facilities to spread their 
workload by controlling the number of patients scheduled 
to visit on a given day. 

The percentage of experienced patients with a gap in 
medication supply of more than 14 days decreased follow- 
ing the intervention, although the difference was not 
statistically significant. In this setting, client visits to the 
health facility are nearly always linked with an antiretro- 
viral prescription refill, except when patients come early 
due to illness or unexpected travel. Antiretroviral medi- 
cines were generally available to patients in all facilities 
that participated in our study; thus, a decrease in medica- 
tion gap would be linked to improved clinic attendance. 
An interruption of more than 14 days of therapy has been 
associated with a 50% probability of virological rebound 
among suppressed patients on a non-nucleoside reverse 
transcriptase inhibitor-based therapy, which predisposes 
them to developing resistance [22], 

When implementing and scaling-up an innovation in a 
complex health system, knowledge about contextual 



factors is essential [23-25]. Therefore, in addition to the 
outcome measures presented here, we conducted inter- 
views with representative members of the health staff and 
observed team meetings and interactions in the work 
places. Interview participants reported that the interven- 
tion allowed facilities to anticipate their daily workload 
and detect clients' missing appointments, which helped 
them take timely action. In addition, information on indi- 
vidual patient attendance helped facility staff target coun- 
selling efforts and adjust the intervals of patient visits. 
Based on the interviews, the most important enabling 
factors appeared to be the involvement of key actors from 
each facility in planning, implementing, and monitoring; 
the positive attitude of health care workers; and a shift of 
staff members' roles within the clinics. Task-shifting from 
health care providers to peer educators, social workers, 
and volunteers helped in the effort to track treatment 
defaulters, remind clients to keep appointments, counsel 
patients, and link patients to community health workers, 
while giving health care providers more time to imple- 
ment the intervention [Unpublished data from qualitative 
part of the study]. Implementation constraints included 
poor coordination and weak management structures 
within the facilities, high staff turnover, lack of funds to 
follow-up patients who missed appointments, and staff 
shortages. 

In considering national scale-up of this intervention, we 
would recommend: paying attention to local contexts, 
incentives, and institutions; anticipating unintended con- 
sequences; and developing and implementing programs 
that engage key actors by using data for ongoing problem- 
solving [23], 

Methodological considerations 

The availability of routine data on clinic attendance 
and dispensed medicine enabled us to use interrupted 
time series analysis to demonstrate the impact of the 



Table 2 Estimated changes in appointment keeping and medication gaps resulting from the intervention among experienced and newly treated patients 



Pre-intervention trend (% per month) Change in level (absolute) Change in trend (% per month) 



Indicator 


Cohort 


Group 


Coefficient (± 95% CI) 


p-value 


Coefficient (± 95% CI) 


p-value 


Coefficient (± 95% CI) 


p-value 


Keeping appointment or attending before appointment 


Exp. 


Intervention 


-0.25 (-0.54, 0.04) 


0.096 


5.67 (2.07, 9.28) 


0.002 


1.04 (0.61, 1.47) 


<0.001 






Control 


0.12 (-0.21, 0.45) 


0.485 


-2.78 (-7.72, 2.15) 


0.268 


0.64 (-0.05, 1 .34) 


0.071 






Difference 


-0.52 (-1,-0.04) 


0.033 


9.56 (-16.07,-3.04) 


0.004 


0.48 (-1.29, 0.33) 


0.248 




New 


Intervention 


-0.14 (-0.72, 0.43) 


0.622 


8.75 (1.21, 16.29) 


0.023 


-0.44 (-1.39, 0.51) 


0.365 






Control 


0.08 (-0.45, 0.61) 


0.769 


-1.8 (-9.84, 6.23) 


0.660 


0.85 (-0.16, 1.85) 


0.100 






Difference 


-0.72 (-1.7, 0.26) 


0.147 


15.39 (-26.4, -4.38) 


0.006 


-1.23 (-0.31, 2.76) 


0.117 


Keeping appointment within 3 days 


Exp. 


Intervention 


-0.18 (-0.38, 0.01) 


0.064 


4.16(1.63, 6.69) 


0.001 


0.84 (0.58, 1.09) 


<0.001 






Control 


0.31 (-0.15, 0.76) 


0.186 


0.49 (-5.41, 6.4) 


0.870 


-0.12 (-0.88, 0.65) 


0.765 






Difference 


-0.71 (-1.17, -0.25) 


0.003 


6.46 (1.35, 11.58) 


0.013 


0.96 (0.16, 1.77) 


0.019 




New 


Intervention 


0.23 (-0.44, 0.89) 


0.503 


2.68 (-5.34, 10.69) 


0.513 


0.02 (-1.35, 1.4) 


0.973 






Control 


0.23 (-0.12, 0.58) 


0.194 


-1.13 (-9.68, 7.43) 


0.796 


0.11 (-0.86, 1.08) 


0.823 






Difference 


-0.27 (-0.87, 0.33) 


0.374 


7.85 (-17.16, 1.45) 


0.098 


-0.31 (-0.8, 1.42) 


0.585 


Medication gap more than 14 days 


Exp. 


Intervention 


-0.15 (-0.62, 0.32) 


0.523 


-11.3 (-22.72, 0.07) 


0.051 


0.18 (-1.09, 1.46) 


0.778 






Control 


-0.48 (-0.94, -0.02) 


0.041 


-0.68 (-6.03, 4.66) 


0.802 


0.13 (-0.62, 0.87) 


0.739 






Difference 


0.33 (-0.37, 1.02) 


0.355 


-10.64 (-22.62, 1.33) 


0.081 


0.06 (-1.22, 1.34) 


0.931 




New 


Intervention 


-0.37 (-1.42, 0.67) 


0.484 


-8.24 (-19.13, 2.65) 


0.138 


0.9 (-0.52, 2.32) 


0.212 






Control 


0.05 (-0.44, 0.54) 


0.830 


-3.87 (-12.43, 4.69) 


0.376 


0.14 (-1.15, 1.42) 


0.833 






Difference 


-0.43 (-1.75, 0.90) 


0.529 


-4.37 (-17.6, 8.86) 


0.517 


0.77 (-1.15, 2.68) 


0.434 



Exp. = Experienced patients, New = Newly treated patients; Figures in bold show significant differences between intervention and control group. 
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Figure 4 Difference in average % of visits kept within 3 days, experienced patients. 



intervention. The use of time series displays has been 
recognized as a robust method of identifying and visualiz- 
ing patterns in complex systems [23]. Segmented regres- 
sion analysis of interrupted time series data makes it 
possible to assess, in statistical terms, how much an inter- 
vention changed an outcome of interest immediately and 
over time, instantly or with delay, transiently or long-term 
, and whether factors other than the intervention could 
explain the change [26]. Changes can be associated and 
attributed to specific interventions at specific points. Our 
study's use of control facilities and staggered intervention 
minimized the risk of external confounders. 

The intervention and analysis were at the system level; 
we did not investigate individual patient characteristics 
and how they affect adherence. Medical records at 
facilities had limited demographic data, which could have 
been useful in exploring adherence at the patient level. In 
addition, data on opportunistic infections were not 
consistently available. Records on the quantities of medi- 
cines dispensed from the pharmacy were occasionally 
missing. In these instances, we imputed the quantities 
using an algorithm based on observed clinic norms at 
individual facilities. We could not perfectly match inter- 
vention and control facilities as demonstrated by differ- 
ences in baseline characteristics, a common situation in 
group randomized trials with small numbers of groups. 

Notably, the differences in baseline characteristics 
between study and control facilities that were observed 
regarding WHO Staging (mostly based on clinical staging) 
and CD4 values at start of treatment indicate that the 
intervention facilities had patients who appeared to be 
sicker at the initiation of therapy. Future studies should 
determine if sicker patients actually have poorer appoint- 
ment keeping trends even when on maintenance phase 
(after 6 months of therapy). 

Although the number of intervention facilities was small 
(n = 6), the analysis methods used are robust for the 
aggregated data. However, we are unable to statistically 



compare one facility to another due to the relatively small 
sample sizes at each facility. Because we sampled facilities 
with between 100 and 500 patients on ART, we are not 
sure if our results would apply to facilities with higher or 
lower number of registered patients. 

At the end of the study 272 of 446 of patients were still 
in care at the intervention arm, and 304 of 352 patients in 
the control arm representing an attrition rate of 39% and 
14% respectively. Statistical comparison of baseline 
characteristics of the subset identified as dropped out, 
versus those that remained till the end of the study in the 
intervention arm demonstrated that the subset that 
dropped out was not systematically different from the one 
that remained. Therefore, we believe that the potential 
bias arising from the differential dropouts in the interven- 
tion and control arms is of limited importance, although 
we cannot exclude the possibility that other factors may 
be responsible for the observed differences. In some of the 
patients' clinical files, dropout was cited to be due to 
transfer out to other facilities, death, and loss to follow up. 
However, we were unable to compute the specific contri- 
bution of each reason cited, because the reason for loss to 
follow-up was not specified in most of the files. 

Conclusion 

This study demonstrated that a facility-based interven- 
tion could strengthen the appointment-tracking and 
performance-monitoring system and that the use of 
facility-generated indicators was feasible and built the 
staffs capacity to help patients improve their clinic 
attendance. For this approach to be scaled-up to the 
national level, the local context and the complex nature 
of the health system should be considered. 

Additional file 

r > 

Additional file 1: Modified MoH 257 for Adherence Intervention 
Study. 
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